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Abstract 

This is a the first in a series of two articles devoted to the question of local 
solvability of doubly characteristic second order differential operators. Consider 
doubly characteristic differential operators of the form 

m 

(0.1) L = ajk{x)XjXk + lower order terms, 

i,fc=i 

where the Xj are smooth real vector fields and the ajk are smooth complex coeffi- 
cients forming a symmetric matrix A{x) := {ajkix)}j^k- We say that L is essentially 
dissipative at xq, if there is some € M such that e*^L is dissipative at xq, in the 
sense that Re (e*^^(xo)) > 0. For a large class of doubly characteristic operators L 
of this form, we show that a necessary condition for local solvability at xq is essential 
dissipativity of L at xq. By means of Hormander's classical necessary condition for 
local solvability, the proof is reduced to the following question: 

Suppose that Qa and Qb are two real quadratic forms on a finite dimensional 
symplectic vector space, and let Qc '■= {Qa,Qb} be given by the Poisson bracket 
of Qa and Qb- Then Qc is again a quadratic form, and we may ask: When can we 
find a common zero of Qa and at which Qc does not vanish? 

The study of this question will occupy most of the paper, and the answers may 
be of independent interest. 

In the second paper of this series, building on joint work with F. Ricci, M. Peloso 
and others, we shall study local solvability of essential dissipative left-invariant 
operators of the above form on Heisenberg groups, in a fairly comprehensive way. 
Various examples exhibiting a kind of exceptional behaviour from previous joint 
works, e.g., with G. Karadzhov, have shown that there is little hope for a complete 
characterization of locally solvable operators on Heisenberg groups. However, the 
scheme of what rules local solvability of second order operators on Heisenberg groups 
in general becomes evident from our work. ^ 
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1 Introduction 



Consider a second-order differential operator of order k with smooth coefficients 

\a\<k 

, d \''' f d 

on an open subset Vl of M", where D 



2iTi dxi J \ 2711 dxr, 
L is said to be locally solvable at Xq G fl, if there exists an open neighborhood U of Xq such 
that the equation Lu = f admits a distributional solution u G V'{U) for every / G C^{U) 
(for a slightly more general definition, see Q). 

Around 1956, Malgrange and Ehrenpreis proved that every constant coefficient oper- 
ator is locally solvable, and shortly later H. Lewy produced the following example of a 
nowhere solvable operator on M?: 

Z = X -lY , where X := - — , ¥:= — + -—. 

ox 2 ou ay 2 ou 

Not quite incidentally, Z is a left-invariant operator on a 2-step nilpotent Lie group, the 
Heisenberg group Hi. 

This example gave rise to an intensive study of so-called principal type operators, 
which eventually led, most notably through the work of Hormander, Maslov, Egorov, 
Nirenberg-Treves and Beals-Fefferman, to a complete solution of the problem of local 
solvability of such operators (see 

Let us recall some notation. Denote by Pk{x,^) := J2\a\=k ^0(2^)^" the principal symbol 
of L. We shall consider pk as an invariantly defined function on the reduced cotangent 
bundle C := T*n \ = x (M" \ {0}) of fi. 

Let us denotes by tti the base projection tti : T*Q Q, (x,^) 1— > x. T*Q carries a 
canonical 1-form, which, in the usual coordinates, is given by a = "^^^i^jdxj, so that 
T*n has a canonical symplectic structure, given by the 2- form da = 'Yl^=id£,j A dxj. In 
particular, for any smooth real function a on fi, its corresponding Hamiltonian vector 
field Ha is well-defined, and explicitly given by 

^ f da d da d 
Ha := 2^ 



d^^j dxj dxj d^j 



If 7 is an integral curve of Ha, i.e., if ^7(t) = Ha{'j{t)), then a is constant along 7, and 7 
is called a null bicharacteristic of a, if a vanishes along 7. Finally, the (canonical) Poisson 
bracket of two smooth functions a and b on T*{Q) is given by 



n . 

{a, b} := da{Ha, H,) = Hab = J2y 



da db da db 



d^j dxj dxj d^j 



Let 

S = {pfc = 0} C C 

denote the characteristic variety of L. L is said to be of principal type, if D^p2 does not 
vanish on E (or, more generally, if for every C ^ ^ there is a real number 6 such that 
(i(Re (e*^Pfc))(C) and a{() are non-proportional). 
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In 1960, Hormander proved the following fundamental result on non-existence of so- 
lutions (see [3]): 

Theorem 1.1 (Hormander) Suppose there is some G \ {0} such that 

a{xo, ^o) = K^o, 6) = and {a, b}{xo, ^o) 7^ 0, 

where a := Repk and b := Imp^. Then L is not locally solvable at xq. 

A complete answer to the question of local solvability of principal type operators L 
was eventually given in terms of the following condition {V) of Nirenberg and Treves: 

(V). The function Im (e^^pk) does not take both positive and negative values along a 
nuU-bicharacteristic 7e(t) of Re (e*^pfc), for any 9 eM.. 

In fact, L of principal type is locally solvable at xo if and only if {V) holds over some 
neighborhood of Xq. Notice that this is a condition solely on the principal symbol of L. 

In this article, we shall consider second order differential operators L with double 
characteristics. Let 

S2:={(x,e)eC: D^p2{x,O = 0}. 

By Euler's identity, S2 is contained in the characteristic variety S, and so S2 consists of 
the doubly characteristic cotangent vectors of L. 

If P2 is real, and if we assume that E2 is a submanifold of codimension m < n in C, 
such that rank -D|j92 = for every ^ G S2, then the following has been shown in |S| : 

Given any xq G 7ri(S2), there exist suitable linear coordinates near xq such that, in 
those new coordinates, p2 can be written in the form 

(1.2) p2(x,o = xe+Eix)e)Aix){e+E{x)e) 

with respect to some splitting of coordinates C, = (^',^"); ^' ^ ^"^j ^" ^ M""™'. Here, 
A{x) G Sym (m, M) is non-degenerate and E(x) G M™^'^"~™')(M), and both matrices vary 
smoothly in x (as usually, Sym {n, IK) denotes the space of all symmetric n x n matrices 
over the field K, where IK will be either M or C.) 

Motivated by this result, let us assume here that L is a complex coefficient differen- 
tial operator with smooth coefficients, whose principal symbol is given by ()1.2j) where, 
however, now A{x) G Sym (m, C) is a complex matrix. We then write 

A{x) = A{x) + iB{x), xeVl, 

with A{x), B{x) G Sym (m, M). Notice that ()1.2p means that, up to a factor (27r)~^, L can 
be written as 

m 

(1.3) L = ajk{x)XjXk + lower order terms, 

j,k=i 

where Xj is the real vector field 

(1.4) = t J = i.....". 

J l=m+l 
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with A{x) = {ajk{x)}j^k, E{x) = {Eji{x)}jj. 

It may be worth while mentioning that every second order differential operator L, 
whose principal part is of the form 

m 

(1.5) f^Ax)Y,Y,, 

j,k=i 

with smooth real vector fields Yj which are linearly independent at xq, can be put into this 
form, locally near xq. This can easily be seen by means of a suitable change of coordinates 
and choice of a suitable new basis Xi, . . . , Xm of the C°°-module spanned hj Yi, . . . ,Ym. 
Moreover, by (jl.2p . 

E2 D {(x, G C : r + E{x) e = 0} C {(x, G C : dp^^x, = 0}, 

so that in particular 7ri(S2) = fl, and equality holds in these relations, if, e.g., A{x) is 
non-degenerate. Finally, denote by qj the symbol of Xj (up to a factor 2tt), i.e., 

n 

Qjix, ■= + Y Eji{x)^i , J = 1, . . . , m , 

Z=m+1 

and define the skew-symmetric matrix 

(compare jH]). Here, {■, •} denotes again the canonical Poisson bracket on T*Q. Observe 
that J{x,£,") depends indeed only on x and the ^'-component of ^. Notice also that if 
A{x) is non-degenerate, then J{xo,^'^) is non-degenerate if and only if S2 is symplectic in a 
neigborhood of (xo,^o); where is chosen so that (xo,^o) G S2 (see, e.g. Proposition 
3.1, Ch. VII). 

If J{x,^") is non-degenerate, then we can associate to J(x,c') the skew form 

cj(^,^")(w,w) := \ J(^x,^")Y^ v,w e M"", 

which defines a symplectic structure on M"*. In particular, m = 2d is even. 

Recall that if uj is an arbitrary symplectic form on M^'^, then we can associate to any 
smooth function a on M^"^ the Hamiltonian vector field iJ^ such that uj{H'^, Y) = da ■ Y 
for all vector fields Y on M^'^, and define the associated Poisson bracket accordingly by 

{a,b}^:=u;iH:,H^). 

We can thus define a Poisson structure {-, on M"* (depending on the point 

by putting {-, := {•, - jc.,^ ^,,)- 

In order to formulate our main theorem, we neeed to introduce some further notation 
concerning quadratic forms. 

If A G Sym (n, K), we shall denote by Qa the associated quadratic form 

Qa{z) := 'zAz, z e K", 
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on K". For any non-empty subset M of a K- vector space V, spangM will denote its linear 
span over K in V. 

Let A,B& Sym (m, M). We say that A, B form a non-dissipative pair, if is the only 
positive-semidefinite element in spanK{^,-B}. Moreover, we put 

maxrank {A, 5} := maxjrankF : F G spanK{^, -B}} 
minrank {A, B} := minjrank F : F E span m{ A, B} ^F ^ 0}. 

Observe finally that if Qa and Qb are quadratic forms on M™, then {Qa, is 
again a quadratic form. 

We can now state our main result. 
Theorem 1.2 Let L he given by (|1.3|) . anc? let Xq ^ Q. Assume that 

(a) A{xo), B{xq) forms a non-dissipative pair. 

(b) There exists some ^ M"~™ \ {0} such that ./(xo,?^') non-degenerate, and the ma- 
trices A{xo), B{xo) and C{xq,C,q) are linearly independent overM., where C{xo,$,q) G 
Sym (m, M) is defined by 

<5c(a;o4') := {QA(xo),QBixo)}(xo,e^) ■ 

(c) Either 

(i) minrank {A (xq), -B(a;o)} > 3 anc? maxrank {A (xq), 5 (xq)} > 17, or 

(^zzj minrank {y4(xo), -B(xo)} = 2, maxrank {A(xo), -B(xo)} > 9, anc? the joint ker- 
nel ker74(xo) nkeri?(xo) of A{xq) and B{xq) is either trivial, or a symplectic 
subspace with respect to the symplectic form uj(^xo,^o)- 

Then L is not locally solvable at xq. 

Notice that, like condition {V), the condition in (a) is again a sign condition on the 
principal symbol of L. 

Theorem 1 1 . 21 shows that a "generic" operator L of the form ()1.3p can be locally solvable 
at xq only, if there is some 6* G M such that Re {e^^A{xo)) > 0. A major remaining task 
will thus be to study local solvability of L under the assumption that A{x) = ReA{x) > 
for every x E Q. A stronger condition is the condition 

(1.6) \B{x)\<A{x), xen. 

This condition is equivalent to Sjostrand's cone condition jTT]. It implies hypoellipticity 
with loss of one derivative of the transposed operator *L, for "generic" first order terms 
in ()1.3p . and thus local solvability of L at xq (see ||4j, Ch. 22.4, for details and further 
references) . 

Since, however, local solvability of L is in general a much weaker condition than 
hypoellipticity of *L, we are still rather far from understanding what rules local solvability 
in general, even when the cone- condition is satisfied. 

Nevertheless, for the case of homogeneous, left-invariant second order differential op- 
erators on the Heisenberg group ]HI„, a rather complete answer had been given in jU], 
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and in the sequel jH] to the present article, we shall extend these results by dropping the 
cone condition, thus giving a fairly comprehensive answer for left-invariant operators on 
Heisenberg groups. 

We should like to mention that, even if the cone-condition is satisfied, for instance 
small perturbations of the coefficients of the first order terms preserving the values at 
Xq, may infiuence local solvability and lead to local solvability in situations where the 
unperturbed operator is not locally solvable at xq (see, e.g., 0). Moreover, if, e.g., 
maxrank {A(xo), -B(xo)} = 5 or 7, then the statement in Theorem 11.21 are known to be 
wrong (see [S],[7j). 

All these results indicate that there is rather little hope for a complete characterization 
of local solvability for doubly characteristic operators in general, but that Theorem 11.21 
in combination with the above mentioned results on hypoellipticity give at least rather 
satisfactory answers in the "generic" case. 

Theorem 11.21 can be reduced by means of Hormander's Theorem 11.11 to the following 
result concerning real quadrics, which may also be of independent interest and which 
represents the core of this work. 

Theorem 1.3 Assume that = M^*^ is endowed with the canonical symplectic form. Let 
A,B ^ Sym(n, M) be linearly independent, and assume that A,B forms a non-dissipative 
pair. Define Qc '■= {Qa.Qb} as the Poisson bracket of Qa and Qb, and assume that 
A, B and C are linearly independent. 

Then there exists a point x G M" such that 

Qa{x) = Qb{x) = and Qc{x) ^ 0, 

provided one of the following conditions are satisfied: 

(i) minrank {y4, 5} > 3 and maxrank {A, 5} > 17, 

(ii) minrank {A, 5} = 2, maxrank {A, 5} > 9, and the joint radical TZa,b '■= ker A fl 
ker B of Qa and Qb is either trivial, i.e., ker A fl ker_B = {0}, or a symplectic 
subspace o/M". 

The article is organized as follows. Sections 2 and 3 are devoted to the proof of 
Theorem 11.31 Notice that this theorem essentially states that the quadratic form Qc '■ = 
{Qa,Qb} can only vanish on the joint zero set {Qa = 0} fl {Qb = 0} of two linearly 
independent quadratic forms Qa and Qb forming a non-dissipative pair, if C is a linear 
combination of A and B. 

Of course, this can only be true if {Qa = 0}n{QB = 0} is sufficiently big, and we shall 
show in Section 2 that (under these assumptions ) the quadrics {Qa = 0} and {Qb = 0} 
do in fact intersect tranversally in a variety JV of dimension n — 2. 

In Section 3.1, we prove some auxiliary results and recall some basic notions and facts 
on semi-algebraic sets. 

The proof of Theorem 1 1 . 31 is then given in Sections 3.1 and 3.2. We distinguish between 
the situation where no stratum of A/" spans M" (Section 3.1) and the case where at least 
one stratum spans (Section 3.2). It is interesting to notice that the condition that Qc be 
the Poisson bracket of Qa and is only needed in the first case (see Theorems 13.51 and 
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I3.12|) . We also present a number of examples in order to demonstrate that the conditions 
in the main Theorem 13.51 of Section 3.1 are essentially necessary. 

Section 4 finally contains the proof of Theorem 11.21 Moreover, we give various ap- 
plications of this theorem to left-invariant differential operators on 2-step nilpotent Lie 
groups (compare CoroUarv 14.11 for general 2-step nilpotent Lie groups, and CoroUarv 14.21 
for the particular case of the Heisenberg group). We also indicate that Theorem 11.21 has 
applications to higher step situations too, for instance on r-step nilpotent Lie groups. 

2 On the intersection of two real quadrics 

If is a K- vector space, and ii vi, . . . ,Vk are vectors in V, then vi A ■ ■ ■ A Vk will denote 
their exterior product in A'^(V"). In particular, vi,...,Vk are linearly dependent if and 
only ii vi A ■ ■ ■ Avk = 0. The open interior of a subset S of some topological space will be 
denoted by S^. 

If M is a non-empty subset of Sym (n, M), then we say that M is non-dissipative, if 
is the only positive-semidefinite element in span^M. 

Lemma 2.1 Let M be a non-empty subset o/Sym(n, M). Then the following are equiv- 
alent: 

(i) M is non-dissipative. 

(ii) There is some positive definite matrix Q > such that 

(2.1) tr ( ^QFQ) = for every F e M. 

(Hi) There is a matrix T G GL [n, M) such that 

(2.2) tr ( ^TFT) = for every F e M. 

Proof, (i) ^ (ii). Let V = Sym {n, M), and let V G V denote the closed cone of positive 
semidefinite matrices in V. Put K := {E E V : tiE = 1}. Notice that E E V has 
vanishing trace if and only if E = 0. Therefore, V \ {0} = IJt>o 

If W := spaniijM, then K and W are convex subsets of V, which are disjoint, by (i). 
Moreover, K is compact and W is closed. By Hahn-Banach's theorem (see, e.g. [TU] . 
Theorem 3.4 (b)), there exists a linear functional fi E V* and 7 G M, such that 

lj{E) > 7 > /i(F) for all EeK, F eW. 

Since W is a. linear space, this implies fi\w = 0, hence fi{E) > for all E E K. 
Choose P eV such that /i(M) = tr (PM) for all M e V. Then 

tr (PE) > for all E eV. 

Rotating coordinates, if necessary, we may assume that P is diagonal, say P = diag(Aj). 
But then clearly Xj > 0, j = 1, . . . ,n, hence P > 0. Choose Q > such that P = Q"^. 
Then 

= tr (Q^F) = tr CQFQ) for all F eW, 
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so that (ED) holds. 

(ii) =^ (iii) is triviaL 

(iii) =^ (i). Assume that F & W and F > 0. Then (iii) imphes that tr [^TFT) = 0, where 
TFT > 0. This imphes TFT = 0, hence F = 0. 

Q.E.D. 

li A E Sym (n, M), then we put 

r^:={^GM":gAW <0}. 

Recall that a pair A,B E Sym (n, M) such that {A, B} is non-dissipative is called a 
non-dissipative pair. Notice that this property depends only on the linear span of A and 
B. In view of Lemma f2. 11 it will sometimes be convenient to assume that a linear change 
of coordinates has been performed so that A, B have vanishing trace. 

By S^~^ we shall denote the Euclidean unit sphere in M", and by Br{x) the open 
Euclidean ball of radius r centered at x G M". 

Theorem 2.2 Let A,Be Sym(n,]R), and assume that 

(2.3) trA = tr5 = 
and 

(2.4) Ta C Tb. 
Then there is some c G M such that 

(2.5) B = cA. 

Proof. After a rotation of coordinates, we may assume that 



A 



Ai 

-^2 



B 



w.r. to the decomposition = M*^ x M^, with (diagonal) matrices Ai > 0, > 0. Write 
corresp ondingly 

Bi Bs 
*i?3 — i?2 

We decompose z G M" as 2; = (x, y) G M'' x M^. 

The case i? = is trivial, so let us assume that B ^ 0. Observe first that 

52 >0, 

for, if ?/ G R\ then {0,y) G Ta, hence - ^^2?/ < 0, by (Q. 
We claim that, for every ?/ G M^, 

(2.6) a(y) := 'yA^y > ^ P{y) := ^^22/ > 0. 

Indeed, if := G : a(y) > 0}, and if y E Q, then, given x G M'^, there is some 
Tx > such that (x, ty) G Fyi whenever t G M, |t| > r^. We thus find that 

%Bix + 2t(i?32/) ■ X - t^(3{y) < provided \t\ > r^. 
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If f3{y) = 0, choosing both signs of t, we see that this imphes 

^xBix < and (Bay) ■x = for all x G R'', 

hence —Bi > and B^y = 0. Therefore, the matrix 

5i 
-B2 

is postive semi-definite. Since it has vanishing trace, it must vanish, so that Bi = 0, i?2 = 
0, and B^y = 0. 

Thus, if P{yo) = for some yo G Q, then P{y) = and consequently B^y = 0, for 
every y ^ Q. Since Q is dense in R^, we obtain B^ = 0, hence B = 0, contradicting our 
assumption on B. This proves ()2.6|) . 
For eeSn:= S^-^ H C M^ put 

QAix) := QAix, e) = ^xAix — a{e) , 

where a{e) = ^eA2e > . Similarly, let 

QUx) := Qb{x, e) = 'xBix + 2{B^e) ■ x - f3{e) , 

where /3(e) = *ei?2e > 0, because of ()2.6|) . 
Finally, for e G S'n fixed, let 

/(^) / = *x—-^x — 1 , 

a(e) a(ej 

1 5 

/3(e) /3(e) 

where ^ := 2-^. From ()2.4p . we know that 

(2.7) /(x) < ^ c/(x) < for all x G 

Lemma 2.3 Lei A,B E Sym(A;,]R), anc? assume that ^ > 0. Moreover, let ^ G R'^, and 
put 

f{x) := *xAx - 1, 

5'(x) := *xBx + ^ ■ a; — 1 . 

Then ()2.7p implies 

(2.8) tr^>tri3. 

Moreover, either f = g, or 

(2.9) tr^>tri3. 
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Proof. Observe that 

(2.10) Af = 2tTA, Ag = 2tTB. 

Assume now that tr ^ < tr B. 
Then, by ()2.10|1 . A{g — /) > 0, so that g — f is subharmonic. Moreover, g{x) — f{x) < 
for f{x) = 0. By the maximum principle, we thus conclude that 

g{x) — f{x) < in the ellipsoid {/ < 0} . 

Thus, there is some e > 0, so that 

- A)x + ^-x < for all X G B,{0) . 

Then also ^x{B — A)x — ^ ■ x < 0, hence 

^B ~A)x<0 for all x E 5^(0) . 

By homogeneity, this implies B — A < 0, hence 

(2.11) B<A. 

In particular, tr i3 < tr^, hence tr^ = tr i3. But then A — B > 0, ti {A — B) =0, hence 
^ - ;B = 0, so that A = B. 

So, either tr^ > trS, or ^ = B. This proves ()2.8p . 
Moreover if ^ = i3, then g{x) = f{x) + ^-x, and, after a linear change of coordinates, we 
may assume that A = I, i.e., 

f{x) = \x\'-l. 

Thus, |x| < 1 implies |xp + ■ x < 1. If 7^ 0, choosing x = we obtain 1 + |.^| < 1, 
hence ^ = 0, a contradiction. Therefore, ^ = 0, hence f = g. 



Q.E.D. 



Going back to the proof of Theorem 12.21 we can now conclude that 

^ -trAi > -^tr5i. 



a{e) (3{e) 



I.e., 



(2.12) P{e)tiAi > a{e)tTBi for all e E Sn , 
and this inequality is strict, unless f = g, i.e., 

(2.13) jIl = ^ and e = (2//3(e))i?3e = . 

a[e) p[e) 

Notice that, by continuity and since is dense in S^~^, ()2.12j) holds indeed for all 
e E S'-\ 

We distinguish therefore two cases. 
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(a) If there exists some e G 5*^ such that (|2.12|) holds strictly, we choose an orthonormal 
basis ei = e, 62, . . . , of M^. Then 

(3{ej)tTAi > a{ej)trBi, j = 

and the inequality is strict for j = 1. Summing in j, we thus obtain 

tri?2tryli > try42tri?i . 

But, since = ti A = tr B, we have tr A2 = ti Ai, tr B2 = ti Bi, hence 

tr^itrAi > trAitr^i , 

a contradiction. 

(b) There remains the case where 

P{e)Ai = a{e)Bi and -836 = for all e E Sq. 
Again, by continuity, this then holds for all e G 5^"^. But then B^ = 0, hence 



B 



Bi 
-B2 



Moreover, Bi = cAi for some c > 0. Then we see that 

(3{e) = ca{e) , for all e G S^~^ , 
which implies, by homogeneity, 

'yB^y = WM)y for all G M^ 

i.e., B2 = CA2. We thus get 

B = cA. 

Q.E.D. 

Proposition 2.4 Let E and D he open ellipsoids in W^,n > 2, whose boundaries don't 
intersect transversally anywhere. Then, if E n D ^ (/), either E G D or D G E. 

Proof. 1. Case n = 2. 

We may then assume that the boundary dD of is a circle 

dD = {{x, y)eR':ix~ 0' + iv - vf = r^} , 

and that 



dE = {{x,y)eR':^ + ^ = l 



where a > 6 > 0. 

Assume also that neither E G D nor D G E. Then, by convexity, dE can neither be 
contained in D, nor in (M^ \ D), i.e., there is a point in dE lying in \ D, and another 
one in D, hence, by continuity of the boundary curve of D, dE fl dD ^ 0. 
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Say that E and D pierce at X e dE fl dD, if every neighborhood U of X contains a 
point in dE \ D and one in dD \ E. 

If E and D don't pierce at any X G dE fl dD, again by continuity of the boundary 
curves of E and D, either dE G D or dD C E, hence E G D or D G E, hj convexity. 

Consequently, E and D pierce at at least one point Xq G dE fl dD. By symmetry, we 
may assume that Xq — {xq, Uq), with Xq >0 and yo ^ 0. 

Assume first < Xq < a, hence < yo < b. U D and E pierce at X, then dD and 
dE must have the same curvature at X, namely 1/r, as can easily bee seen from the 
local Taylor expansions of the boundaries curves. If a = 6, then this implies D = E, 
so assume a > b. Since dD has constant curvature, there are exactly four points on 
dE which are potential piercing points, namely Xq,Xi := {xq, —yQ),X2 :— (— a;o,2/o) and 
X4 :— {—xo,—yo). Moreover, by continuity, there must be at least one more piercing 
point, besides Xq. 

Assume, e.g., that Xi is a second piercing point. Since Uq := (ff, fl) is normal to 



Moreover, computing the curvature of the ellipse dE at Aq, and comparing it with 
that of the circle dD, we then find that 



The case where A'3 is a second piercing point can be treated in a similar way. And, 
X4 cannot be a piercing point, since X^ — —Xq, so that the center of dD would have to 
ly on the two parallel lines A'o + Mi/q and —Xq + R(— i/q), which would imply uq — sXq 

for some s G M. But this is impossible, since a > b. 

The cases where = or = a are even easier, as well as the case where a = b, and 
are left to the reader. 

2. Case n > 3. 

If neither E G D nor D G E, we may choose points Xq G E H D, Xi G E \ D and 
X2 & D\E spanning a two-dimensional affine plane V. We may then reduce the problem 
to the 2-dimensional case by restricting ourselves to the affine plane V. 

Indeed, if E :— {P < 0}, D :— {Q < 0}, for suitable eUiptic quadratic functions P 
and Q, then let 

p{s,t) := P{xo + s{xi-XQ)+t{x2-Xo))^ Po-f{s,t), 

q{s,t) := Q{xo + s(xi - Xq) +t(x2 - Xq)) ^ Q o ^(s,t), (s, G R^. 

Then p and q are elliptic quadratic functions on R^, and 





b/a'' 



1/b 




hence = (1 — ^)(1 — ^). This implies Xq 



a, in contradiction to our assumptions. 



EnV^{p<0}^:E, Dr)V^{q<0}^:D, 
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in the coordinates (s, t) for V. 

And, if p{s, t) = = q{s, t), then Vp(s, t) A Vg(s, t) = 0. For, if Vp(s, t) and Vg(s, t) 
were hnearly independent, then for X = 'j{s,t) G dE fl the vectors 

VQ{X)-D^{s,t) = Vqis,t), 

would be hnearly independent, hence also VP(X) A VQ{X) ^ 0. 

Thus, we could apply Case 1 to and D, and conclude that one is contained in the 
other, say, e.g., E C D. But this would contradict our assumption that Xi G EnV\DnV. 

Q.E.D. 

We shall need the following modification of Proposition 12.41 

Proposition 2.5 Let A, B e Sym(n,]R), A > 0,5 > 0, such that rank A > 2,rankfi > 
2, and let 

D := {x G : QAix) < 1}, E:={xeW: Qb(x) < 1}. 

// the boundaries of D and E don't intersect transversally anywhere, and if E n D 0, 
then either E G D or D G E. 

Proof. We can argue similarly as in the proof of the case n > 3 of Proposition 12.41 

Let TZa = ker A and TZb = kei B denote the radical of Qa and Qb- Since rank A > 2, 
we can find vectors ^1,^2 ^ I^" such that ^1 A ^2 7^ and TZa G C,^ H and similarly 
ii, 6 e such that f ^ A f 2 7^ and 7^s C f ^ H f^. 

If neither E G D nor D G E, we may choose points XQ = 0& Er\D,xi&E\D 
and X2 G -D \ -E spanning a two-dimensional plane V. Choose linearly independent vectors 
rji, . . . , rjn-2 G M" such that V = rj^\^- ■ -Hr^^^.j, and consider oj := ^1 A^2Ar7i A- ■ ■ Ar7„_2- If 
u; 7^ 0, then V fl TZa = {0}, so that Qa\v > is a positive definite, i.e., elliptic, quadratic 
form on V. Similarly, if also u; := ^1 A ^2 A r/i A ■ ■ ■ A ?7„_2 7^ 0, then Qb\v > is elliptic, 
and we can conclude the proof as in Propositior l2.4[ 

We shall show that we can slightly vary the points xi and X2 in order to achieve that 
u and u; 7^ 0. Indeed, since E \ D ^ and since the boundary of D is a smooth 
submanifold of codimension 1, E \ D has non-empty interior, and we may assume that 
Xi lies in this interior. Similarly, we may assume that X2 lies in the interior of D \ E. 
Therefore, there is some e > 0, such that xi + yi E E \ D and X2 + y2 ^ E) \ E for all 
Hi, 1/2 G Bs{0). Let us now replace rjj by fjj = rjj + 6j, with 6j G M" sufficiently small, 
in order to achieve that 7^ 0, u) 7^ 0, for the corresponding n-forms uj and uj. Then we 
can find yi, y2 G B^{0) such that fjjixi + yi) = = %(x2 -|- 7/2) for j = L . . . , — 2 (just 
solve the linear equations fjj ■ yi = —6j ■ Xi, and fjj ■ y2 = —Sj ■ X2, for j = 1, . . . ,n — 2.) 
Replacing xi by Xi + yi and X2 by X2 + y2, we can thus assume that w 7^ and 7^ 0, 
which completes the proof. 

Q.E.D. 

Let us next extend the previous results to non-semidefinite forms. 
If is a linear subspace of Sym (n, M) , we say that A E W has maximal rank in W, 
if rank A = maxrank M. 

For A,B e Sym {n, R) and r > 0, let 

T'A:={QA<r}, r^:={QB<r}. 
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Then in particular = F^^, F^ = F^. Notice that if 2; G c?F^, and if Az 7^ 0, then (9F^ is 
an analytic manifold of codimension 1 near z, and Az is normal to it at z. If such a vector 
z exists, we say that 9F^ is a variety of dimension — 1. If z e (?F^ n 9F^, and if A^; 
and Bz are linearly independent, then we say that the boundaries 9F^ and c^F^ intersect 
transversally at 2;. 

Theorem 2.6 Lei W C Sym (n, M) he a non-trivial subspace of Sym {n, M) and r > 0, 
and fix A & W of maximal rank in W, with signature {k,ii). Let also B & W, and assume 
that 9F^ and SF^ are varieties of dimension n — 1. 

If there is no point in 9F^ fl 9F^ at which the boundaries 9F^ and 9F^ intersect 
transversally, and if \\ B — A \\ is sufficiently small, then either F^ C F^ or F^ C F^, 
provided k > 2. 

Proof. Let i := n — k. After rotating the coordinates and scaling in every coordinate, if 
necessary, we may assume without loss of generality that 

with respect to the decomposition M" = M'^ x M^, where, by our assumption, k > 2, and 
where A2 > has rank £1. 

If £ = 0, i.e., if A = In, and if B is so close to A that B = Bi > 0, then the statement 
is clear, by Proposition 12. 4| if r > 0, and the case r = is trivial. 

So, assume that i > 1. We also assume that B is so close to A that Bi > 0. 
As in the proof of Theorem \2.2\ we decompose z = {x,y), x G M.^, y G M^, and put, 
for y G 

:= QAix, y) = |xp - a{y) , 
QU^) ■■= QB{x,y)='xBix + 2{B^y)-x-(3{y), 

where aiy) := \1A2y > and := \1B2y. Notice that we can write 

(2.14) Qlix) = Xx + B,y)B,{x + B,,y) - 'yB^y, 

with i?4 := B^^Bs and B2 := B2 + ^B^B^^B^. Observe that rank 52 < ii, since A has 
maximal rank in span {A,B}. 

We claim that B2 > and ranki?2 = ^1, if — A|| is assumed sufficiently small. 
Indeed, if — is sufficiently small, then Qb2\w > on a space W of dimension 
ii, and thus also Q^Jvy > 0. If we decompose M.^ = W (B H, then in suitable blocks of 

coordinates {w, h) subordinate to this decomposition, we may write B2 = 

where D > has rank ii. Then Qj^^{w,h) = \w + Sh)D{w + Sh) — ^hFh, for suitable 
matrices S, F, and since ranki?2 < ^1, necessarily F = 0. This implies the claim. 

Let n := R\ if r > 0, and n:=W\ (ker A2 U ker ^2), if r = 0. Notice that if ?/ G fi, 
then r + a{y) > and r + /?(?/) := r + ^-^2^/ > 0, so that the ball 

:= {Q^ < r} = {x G M'^ : \x\^ <r + a{y)} 



D E\ 
\'E F ) 
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and the ellipsoid 

:= {Ql < r} 

have non-empty interiors. 

Notice that we can exclude the case where £i = and r = 0, for then = = -B2, 
so that r° = {0} X and = {(x, G M'^ x : x = —B4X1} have both codimension 
greater or equal to two, so that there is nothing to prove. 

We therefore assume henceforth that £1 > 1, or r > 0. Then Vt is dense in M^. 

Fix uq G such that r + a(?/o) > 0. If we choose ||-B — y4|| sufficiently small, then we 
may assume that r + Vo(^2 — ^B^B^"^ B^)yQ > 0. Modifying yo slightly, if necessary, we 
may in addition assume that r + V0-B22/0 > 0. But then the point {—B^yo, yo) lies in the 
open interior of D^" and of E^". This shows that the set 

Q^:={yeQ: {Oyf H {Eyf ^ 0} 

is a non-empty, open subset of ^2. 
1. Case: £1 > 2, or r > 0. 

Then VL is connected. We prove that then Vti = Q. 

For, otherwise, we find y & Qi and y' G f2 \ Connect y and y' in by a continuous 
path 7 : [0, 1] fl, and put 

A := Df^ , Et := Ef'^ , t G [0, 1] , 

and 

r := inf{t G [0,1] : 7(t) G 

Then 7(r) G f2 \ Qi, since f2 \ fii is closed in Q. Now, observe that for y G r^i, the ball Dy 
and the ellipsoid Ey don't intersect transversally at common points of their boundaries. 
By Proposition 12. 4t since k >2, we then have 

(2.15) C E^, or E^. C for every y G r^i. 
Thus, for some sequence {sj}j in [0, r[ tending to r, we have 

(2.16) Ds^cEs^, oiEs^cDs^. 

By continuity, this implies (-Dt)° H (-E't)° 7^ 0, a contradiction. 

We have thus shown that the alternative ()2.15|) holds for every y eVL. 
However, if D^. C E^. for every y & Q, then 

QA{x,y)<r =^ QB{x,y)<r for all y G . 

By continuity, this remains true also for all y G M^, so that in this case F^ C F^. Similarly, 
if Ey C Dy for every y E fl, then we find that F^ C F^. 
Assume therefore that there exist y,y' E Q such that 

C Ey and Ey' C Df' . 

We claim that we can then find an rj E Q such that 

(2.17) E^l = D^l. 
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Since fl is connected, we can connect y and y' in f2 by a continuous path 7 : [0, 1] Q. 
Put 

Dt := Df^ , Et := Ef^ , t G [0, 1] . 
Then Dq C Eq, Ei C Di. Let 

r := inf{t G [0, 1] : C A} • 

We claim that Ej. = D^, which proves (j2.17p . 

Since Et arizes from a fixed centrally symmetric ellipsoid E by scaling with a positive 
factor and translation by some vector, both depending continuously on t (and similarly 
for Dt), we clearly have E^ d Dr- The case r = is then obvious, so assume r > 0. Then 
Dg C Eg for s < r, so that D^- G E^, hj continuity. 

With 1] as in (j2.17|) . we have in particular 

(2.18) {Ql = r} = {Ql = r} = {x: \x\^ = r + «(r/)} . 
This implies 

^xBix + 2{B^7]) ■ X — [iSij]) + r) = for every x satisfying = (r + aij]))^^'^ . 
Exploiting this for x and —x, we see that 

(2.19) 5377 = 0, 
and then, by scaling, 

'xB^x = (^^PI^\x\^ for all x eR\ 
a{T]) + r 

hence 

(2.20) B, = 

with Pi := {P{ri) + r)/(«(r/) + r). 

Let z := (x,?7), where x = {r + a{r])y^'^x', with x' E S'^^^. Then z G c^F^ fl dT^^, and 
since Az is normal to and Bz normal to 9F^ at z, the assumptions in the theorem 
imply that Az A Bz = 0, where, because of ()2.19p . 

= ( -A2V ) ' = ( ^i^si^- i?2r] ) • 

Thus Bz = PiAz, hence 

(2.21) ^Bsx - B2r] + (3iA2r] = whenever |x| = (r + 0(77))^/^. 

Taking the scalar product with 77, in view of ()2.19p we get —Pirf) + Piairj) = 0, hence 
ria{r])-P{ri)) = 0. 

If r > 0, this implies 0(77) = /?(//), hence 

/3i = l. 
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If r = 0, notice that /?i is close to 1, in view of (|2.2(jp and since ||y4 — is assumed 
small. Therefore, we may replace B by Pi^B, without loss of generality, so that again we 
may assume that Pi = 1. 

Moreover, by ()2.2H) . then 

^B^x = {B2 — ^2)^ whenever |x| = (r + 0(7]))^'''^. 
Applying this to x and —x, we find that B^ = and A2r] = B2T1. We therefore obtain 

where then also -B2 ^ 0. 
Thus 

QA{,x,y) = |xp - QAiiy), QBix,y) = |xp - Qs^iy)- 
Fix X such that |xp — r = 1. Then 

{yem}:QA{x,y)<r} = {y e^! : QaM > 
{yem.':QB{x,y)<r} = {y eM.' : QbM 

and the complements of these sets are given by 

D:={yem.': QaAv) < 1), E := {y eM.' : QbAv) < !}• 

Since, by our assumptions, the boundaries of D and E don't intersect transversally, we 
can apply Proposition 12.51 and find that D G E, ot E G D. Assume, e.g., that the first 
inclusion holds. Scaling in y and taking complements, we then see that 

{yeR': QbM >s}c{yeR': QaM > s} for every s > 0, 

hence 

QBix,y)<r =^ QAix,y)<r, 
whenever |xp > r. This implies C F^. 
2. Case: ii = 1 and r = 0. 

Then there are vectors C,i,C,2 \ {0} such that A2 = <^ ^1 and -B2 = ^2 ® ^2, i-e., 

Qlix) := 

Qy^{x) := Xx + B,y)Bi{x + B,y)-{^2-yf, 
and = \ (^j*- U ^2) is non-connected. 

(a) Assume first that ^1 A ^2 7^ 0. Then Q consists of four connected components, on each 
of which the sign of ■ y and ^2 • 2/ is constant. Let V be one if these components such 
that V contains a point in Qi. Arguing as in Case 1, we can then conclude that V <Z Qi, 
so that the alternative (|2.15p holds for every y In particular, if y G "P is sufficiently 
close to the hyperplane then \Dq\ < \Eq\, hence Dq C Eq. Here, \M\ denotes the 
Lebesgue volume of a Lebesgue measurable subset M of M'^. Similarly, if y' is sufficiently 
close to the hyperplane then Eq C Dq . Connecting y and y' by some continuous path 
7 in P, we can thus conclude as in Case 1 that there is some r] E V such that Eq = Dq. 
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As in Case 1, this implies that 3^ = and Bi = Ai, without loss of generality. Moreover, 
by (j2.2H) . since Pi = 1, then ,82^ = ^2^, hence (^1 ■ 77)^1 = (^2 ■ v)^2- This contradicts our 
assumption that C,i A ^2 7^ 0, and thus this case cannot arize. 

(b) Assume finally that ^1 A ^2 = 0. By a linear change of coordinates in M^, we may 
then assume that ■ y = yi and C,2 ■ y = ayi, for some a > 0, so that fl consists of the 
two connected components Q± := {?/ G : ±yi > 0}. As before, at least one of these 
components must belong to fli. But, since D^^ = —Dq and Eq^ = —Eq, we see that 
?/ G fii if and only if —y G Qi, and thus = fii. In particular, the alternative (|2.15p holds 
for every y & Q. Following the arguments applied in Case 1, assume again that there are 
y,y' E Q such that 

Df C E^ and E^' C Df' . 

We can then assume that y and y' ly in the same component of fl, say, e.g., 

To see this, notice that a change of sign of y does not change the volumes of and 

Ey. Thus, if Dy C Ey, then E^y C D-y = Dy would imply E-y C Dy C Ey, hence 

E-y = Dy = D~y. This shows that Dy C E^! implies D;y C E-y. 

Then we can connect y and y' within by some continuous path 7, and thus find some 

r) G fl+ such that Eq = Dq. As before, this implies that i?3 = and Bi = Ai, without loss 

of generality, and moreover B2rj = ^2?], hence a = 1. But then = Qbi hence T\ = F^. 

Q.E.D. 

Remark 2.7 If A; = 1, the statement in Theorem 12.61 may fail to be true. Take, for 
instance, := — y^, Q b{x , y) := — 2exy — y"^ , e > 0, for (a;, ?/)g]R^. 

Corollary 2.8 Let W C Sym (n, M) he a non-trivial suhspace of Sym (n, M), and fix A E 
W of maximal rank r in W. Let also B E W, and assume that OTa and OTb are varieties 
of dimension n — 1. 

If there is no point in OTa Cl OTb at which the boundaries OTa and OTb intersect 
transversally, and if \\B — A\\ is sufficiently small, then either Ta C F^ or Tb C F^, 
provided r > 3. 

Proof. Assume that A has signature {k,^l). The case /c > 2 is then covered by Theorem 

If < 1, then ii > 2, since r = k + ii > 3. The case = is trivial, since then 
Ta = Tb = I^"- So assume k = 1. Applying Theorem 12.61 to —A and —B, we find that 
T_A C F_B or T_B C F„^. Say, the first inclusion holds. Then also (F_yi)° C (T^b)^, 
hence 

Fb = M"\(F_b)°cM"\(Fa)° = F^, 
so that the statement of the corollary is true also if /c = 1. 

Q.E.D. 

From Theorem 12.21 and CoroUarv 12.81 we immediately obtain 

Theorem 2.9 Let A,B E Sjm{n,'R) be a non-dissipative pair, and let us assume that 
maxrank {A, B} > 3. 

If A and B are linearly independent, then there exists a point z G (9F^ nSF^ at which 
the boundaries OTa and dTB intersect transversally. 
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Proof. Let W := span^{A, B}, and choose a basis A, B of W such that rankA = 
maxrank {A, B}, and such that | |i? — A| | is so small that Corollary 12 . 81 applies to the pair 
A,B (notice that the boundaries dT^ and dT^ have dimension n — 1, because A and B 
have signature {k,ii), with k > 1 and ii > 1, since W is non-dissipative.) Observe that 
dVAndTB = dT^ndV^. 

Assume now that there is no point z G dTj^ (^OTb at which Az A Bz ^ 0. Then there 
is also no point z G dT^ H SF^ at which Az A Bz ^ 0, and consequently C or 
F^ C F^. However, in view of Lemma l2.ll after a suitable linear change of coordinates 
we may assume that A and B have vanishing traces. Then, by Theorem 12.21 A and B are 
linearly dependent, hence so are A and B. This proves the theorem. 

Q.E.D. 

Remark 2.10 The analogous statement is false for r = 2. Take, for example, Qa[^^i u) = 
x^-y"^, QB{x,y)=xy, {x,y)eR^. 

3 The form problem 

We begin with some auxiliary results and background information on semi-algebraic sets, 
which will be useful later. 

3.1 Auxiliary results 

Lemma 3.1 Let A,Be Sym(n, M) such that A is not semi- definite, and assume that 
dVACdTB. 

(a) Then there is a constant c G M such that B = cA. 

(b) //rank A = 2, so that 9F^\{0} is not connected, then let us choose linear coordinates 
X = {xi, . . . ,Xn) SO that Qa = 0x1X2, with a G M \ {0}. If Qb vanishes on one of 
the components of OVa \ {0}, say Qb{x) = 0, if xi = 0, then there is some & G M" 
such that Qb{x) = {b ■ x)xi. 

Proof, (a) After applying a suitable linear change of coordinates, we may assume that 
we can split coordinates x = {u, v, w) G M'^ x x M™ = M" such that 

Qa{x) = |Mp - \v\^ =: QA^iu,v) . 

Setting y := {u,v) G M^"*"^, we can then write Qb as 

Qb iy,w) = Qb^ (y) + {B2y) -w + QBsiw), 

with Bi G Sym {k + i, M), S3 G sgn (m, M) and B2 a real m x (A; + £)-matrix. Let y G 9F^j. 
Then QB{y,w) = for all w G M™, hence 

(3.1) B, = 0, B2y = and QbAv) = • 

Since, by our assumptions, k > 1, i > 1, OTa^ spans M'^^^. To see this, choose unit vectors 
ei,...,efc G M.^ spanning M'^ and unit vectors fi, . . . , fi G spanning M^. Then the 
vectors Cj ± fj ly in OTai and span]R'^+^. Then (13. 1|) implies B2 = 0, so that 

Qsiy^w) = QbAv) ■ 



19 



We may thus reduce ourselves to the case m = 0. Let us then write (with new matrices 

Qb{u, v) = Qb^ (u) + {v) + 2{B^v) ■ u . 
For {u',v') G S'''^ X S^^^ and s,t eR, we have 

q{s,t) := QB{su',tv') =s^QBAu')+t^QB2{v') + 2st{B3v')-u' 
= as^ + pt^ + 2^st. 

By our assumptions, q{s,t) = 0, if |s| = |t|. In particular, q{t,t) = q(t, —t) = 0, so that 
7 = and a + P = 0. Thus 

{B^v') -u' = for all u' e S''-\ v' e S^-^ , 

so that i?3 = 0. Moreover, 

[u') = -Qb; {v') for all u' G S''-\ v' G S^~^ . 

Scaling, this implies 

Qbi{u) = -\u\^Qb2{v') for all m G , 

hence Bi = elk, for some c G M. Then Qb2{v') = — c, hence Qb2{'^) = — c|f P for all v G 
M^, so that i?2 = —cli and Qb = cQa- 

(b) If (^^(a;) = for xi = 0, then put s := Xi, v := (x2, ■ ■ ■ , x„), and write 

Qb{x) = Qbi (v) + s(3 ■ V + 7s^ . 
Since Qb{v, s) = 0, if s = 0, we have Bi = 0, so that Qb = s{f3 ■ v + 7s). 

Q.E.D. 

If V and W are finite dimensional IK— vector spaces, we shall denote by L{V, W) the 
space of all linear mappings from V to W. If V = R^ and W = M.^ are Euclidean spaces, 
we shall often identify a linear mapping T G L{V, W) with the corresponding n x k— 
matrix in M^^^(K) with respect to the canonical bases of these spaces, without further 
mentioning. 

Lemma 3.2 Let A G L(]R",]R") and T G L(]R"^™', M*^) be linear mappings, and assume 
that T is injective. Then 

rank ( ^TAT) > rank A - 2m. 
Proof. It suffices to prove that 

(3.2) dim(ker *r *AT) < dim(ker *A) + m, 

for then rank ( *rAT) = n — m — dim(ker *r *A T) > n — dim(ker *A) — 2m = rank A — 2m. 
Write B := *A. Since T is injective, fl3.2p will follow from 

(3.3) dim(ker ^TB) < dim(ker B) + m. 

Let K := ker *r. Then y G ker 'TB if and only if By G K, i.e., ker 'TB = B^^{K), where 
clearly dim B~^{K) < dim(ker S) + dim if = dim(ker 5) + m. This gives ()3.3p . 

Q.E.D. 
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Lemma 3.3 Let A, B E L(]R", M") be linear symmetric mappings, i.e., *A = A and 
= B, and let I be a non-empty open interval in M and E : I ^ L(]R"'~™, M") a 
differentiate mapping such that E{t) is injective for every t E I. Assume that 

(3.4) ^E{t)BE{t) = ii{t) ^E{t)AE{t) for every t e /, 

where fi : I is a differentiable mapping. Then fi is constant, provided rank A > 4m. 
Proof. Let r := rank A, and put 

A{t) := ^E{t)AE{t), B{t) := ^E{t)BE{t), t E I. 

Then 

B{t) = n{t)A{t) foralltG/. 

Assume that n is non-constant. Then there is some point t^ E I such that /i(to) •= 
^(to) 7^ 0. Translating coordinates in M, if necessary, we may assume that to = 0. 
Moreover, replacing then B by 5 — /i(0)y4, we may assume that /i(0) = 0, hence -B(O) = 0. 
Then 

5(0) = ^(0)^(0) , 

hence, by Lemma (3. 2t 

(3.5) rank 5(0) = rank A(0) > r - 2m . 
On the other hand, 

5(0) = *5(0)55(0) + \ 'E{Q)BE{Q)) , 

and 

= 5(0) = *5(0)55(0) . 

Since -E'(O) is injective, this implies *5(0)5|y(o) = 0, where V{Q) denotes the (n — m) — 
dimensional range of 5(0), so that rank '^E{0)B < m, hence 

rank *5(0)55(0) < m . 

The same estimate holds for *( *5(0)55(0)), and thus 

rank 5(0) < 2m. 

Together with ()3.5p . this yields r < 4m. 

Q.E.D. 

In the sequel, we shall consider three matrices A,B,C E Sym(n, M), and shall work 
under the following assumptions, unless stated explicitly otherwise: 

Standing Assumptions 3.4 A and B are linearly independent and form a non-dissipative 
pair, and r := maxrank{A,5} > 3. Moreover, C statisfies the following property: 

(HI) Qc vanishes on {Qa = 0} fl {Qb = 0} . 

Unless stated otherwise, we also assume that rank A = r, and that ||5 — y4|| is sufficiently 
small. 



21 



We shall be mostly interested in the situation where M" = M. is the canonical sym- 
plectic vector space, and Qc is the Poisson bracket 



(H2) 



Qc = {Qa,Qb} 



of Qa and Qb- Our aim will be to prove that, under these assumptions. 



(3.6) 



C = aA + (3B 



for some a,/? G M, provided r is sufficiently large. 

Let us first have a closer look at the structure of the sets {Qa = 0} = OTa, {Qb = 
0} = OTb and their intersection 



As a reference for the following results, we recommend pp. 

The sets dTA,dTB and V are real-algebraic, hence semi- algebraic, so that they admit 
a finite stratification into connected, locally closed subsets which are real-analytic subma- 
nifolds, each of which is a semi- algebraic set. Recall that the dimension of a semi-algebraic 
set is the maximal dimension of its strata. 

If we assume that B is so close to A that also ranki? = r, then clearly OTa and OTb 
are of dimension n — 1 , so that dim V < n — 1. 

Theorem 12.91 implies that there exist points 2; G V, at which the boundaries of OTa 
and OTb intersect transversally. 

Denote by A/" C V the set of all those points z in V. Then A/" is a non-empty analytic 
submanifold of codimension 2 in M", and Az, Bz span the normal space N^M to M at 
every point z G M. 

In particular, M decomposes into a finite number of strata of dimension n — 2 contained 
in V, so that dim V > n — 2. It is easy to see that dim V = n — 1 is not possible. 

For, if dim V = n — 1, then there exist a non-empty open neighborhood U of some 
point 2; G V in M" such that 



If > 2 and ^1 > 2, then dV a \ {0} is connected, and since Qb vanishes on dV a \ {0} 
within f/, it vanishes on the whole of dV a-, by analyticity. And, if, e.g., = 1, then 
the semi-cones dV^ := {x : Qa{x) = Oand ± Xi > 0} are connected, and a similar 
argument as before shows that Qb vanishes on at least one of the sets dV\ or dV^. Since 
Qb{—x) = Qb{x), then again Qb vanishes on OTa- 

Reversing the roles of A and B, we see that OTa = OVb- But then A/" = 0, a 
contradiction. We thus have 

(3.7) dimV = n-2. 



V := OTa n dV 



dTAr\u = dTBr\u = OTa n ar^ n . 



However, we may apply a linear change of coordinates so that 



Qa{x) — {x\ + ■ ■ ■ + x\) + ■ ■ ■ + X£ J . 
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3.2 The case where no stratum of J\f spans W^. 

We first rule out the possibility that no component of M spans M". 

Theorem 3.5 Let A,B,C G Sym(n, M) satisfy our Standing Assumptions 3^7 Assume 
that maxrank{A, 5} > 7, that M" = M^*^ is symplectic, that Qc satisfies Hormander's 
bracket condition (H2) and that the joint radical TZa,b '■= kerA n kei B of Qa and Qb is 
either trivial, i.e., keiAnkeiB = {0}, or a symplectic subspace o/M". 

Suppose also that no connected component of Af spans M". Then C is a linear combi- 
nation of A and B. 

Proof. Without loss of generality, we may assume that 71a,b is trivial. For, if 71a,b is 
a symplectic subspace, then we can choose a complementary symplectic subspace of M", 
and reduce everything to this space. 

Let then Xa{x) := 2JAx, Xb{x) := 2JBx denote the Hamiltonian vector fields asso- 
ciated to Qa and Qb- Since 

XaQb = {Qa,Qb} = on Af, 

the field Xa is tangential to dT b at every point of V C A/", and trivially the same holds 
for dV A-, so that by symmetry in A and B, 

Xa{x),Xb{x) G TM for a\\ xeM . 

Assume now that no connected component of M spans M". 
Let A/o be any component of M . Then 

(3.8) TVo C z/^ 

for some unit vector v G M". In particular, Xa{x),Xb{x) G z/^, hence 

u G spanK{X^(a;), Xs(a;)}^ for all x G Aq . 

Here, _L denotes the orthogonal with respect to the canonical Euclidean inner product on 
M". Then Jv G spanRjAx, hence 

(3.9) Ju G TxMq for every x G Aq . 
Let 

V := (spanM{z/, Jz/})^ . 

Then ^ is a J-invariant, symplectic subspace of M"^, and we can choose orthonormal 
coordinates xi, . . . , so that 

V = e„_i, Ju = Cn, 

where ei, . . . , e„ denotes the associated basis, and where ei, 63, . . . 62^-1, 62, ... , e2d forms 
a symplectic basis of M". 

Representing A/q locally as a graph, we see that (j3.9p implies that A/q is locally a 
cylinder with axis e^, over a basis Ai C M"^^; by analyticity of Qa and Qb, we see that 
this holds globally: 

(3.10) Afo = MxR, 
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where 

M:^{ye R"-^ : {y, 0) e Mo} C R""^ . 

Notice also that, since <Zv-^ — e^_]^, we have indeed that M. can be considered as an 
{n — 3)- dimensional submanifold 



(3.11) 



M <Z {y e 



Dn— 1 



yn-1 = 0}=:H 



of the {n — 2) -dimensional hyperplane H in R" ^, which can naturally by identified with 
V = Hx {0}. 

Sphtting coordinates x = {y,s), y E R"~^, s G R, we can write A in the form 



) , with a2 e 

0,2 (I3 



Dn— 1 



Then 



QA{y, s) = QA^y) + 2s(a2 ■ y) + a^s^. 
Since QA{y, s) — Q for all s e R, if y e A4, we find that 

(3.12) 03 = 0,02-^ = and (5Ai(y) = for all y e . 

In particular, 02 G M.-^. 
Case 1. span^A^ = H. 

Then 02 G i?"*", hence 02 = Te„_i for some r G R, so that 

/ 



A, 



\ 



0---0r 



\ 



0/ 



Interchanging the roles of A and B, we see that B is of the same form 





/ 


\ 


B = 


Bi 









a 




\ 0- • -Oct 





with cr G R. If both r and a were zero, then e„ would be in the joint radical TZa,b of 
and Qb, which is assumed to be trivial. Thus, at least one of these numbers is non-zero, 
and forming suitable new linear combinations of A and B (dropping the assumption that 
— y4|| be small), we may assume without loss of generality that 





/ 


0\ 




A = 


A, 





, B 






1 






0---01 


J 





Bi 
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so that 

(3.13) QAiy,s) = (5ai(i/) + 2s?/„_i, 

Qsiy^s) = QbAv)- 

Since A and B are linearly independent, we have rank Bi>l. Moreover, rank i?i = 1 is 
not possible, since then Bi would be semi-definite. Therefore, rank Bi > 2. 

Case 1(a). rank Bi = 2. 

Since Bi is not semi-definite, we can then find linearly independent vectors t^i, ?72 G M""^ 
such that 

Qsiiy) = im ■ y){ri2 ■ y) ■ 

Moreover, by ()3.13|) . 

V n {(y, s) G M"-^ X M : = 0} = {dVA, H dVs, nH)xR, 

so that Ai must be an {n — 3)-dimensional stratum of dr^i fl SF^^ fl if of codimension 
1 in H. In particular, Ai is contained in either rj^, or in 77^. Assume, e.g., that 

M Cr]^ . 

If ?7i A e„_i 7^ 0, then A4 lies in the subspace K := {y E ]R"~^ : = 0, r/i ■ ?/ = 0} 
of codimension 1 of H, hence is an open subset of K. Since Qa^ vanishes on we see 
that Qa^ vanishes on K. Write 



A', a'^ 



with respect to the splitting of coordinates y = {y',yn-i)- Then QA[{y') = whenever 
!][ ■ y' := Tji ■ {y', 0) = 0. Lemma ITT] (b) then implies that QA[{y') = {Vi " y')iV2 ' y)i 
some G M"~^. In particular, rank A'^ < 2. 

On the other hand, if we apply Lemma 13. 2t where T : M"^^ M" is the inclusion 
mapping y' {y', 0) G M""^ x = M", then we see that rankA'^^ > rank A — 4 = r — 4. 
Thus r < 6, in contrast to our assumptions. 

Let us therefore assume that rji A e„_i = 0, say, without loss of generality, rji = e„_i. 
Then 

Qsiy^s) = y^_^{r]-y), 

for some r] G ]R"~^ Write r] = acn-i + f , with v G spauKjei, . . . , e„_2} = V . Then f 7^ 0, 
since is not semi-definite, so that we can consider f as a member of a new symplectic 
basis of V . Replacing {ei, . . . , 6^-2} by this new basis, we may then assume without loss 
of generality that f = ei, i.e., 

Qsiy, s) = (ryl^i + yiyn-i = yn~i{.(yyn~i + z/i), 
QAiy.s) = (y) + 2s?/„_i , 

and that the Poisson bracket of yi and ?/2 satisfies {yi,y2} = 1. Since {s, = 1, we 

then obtain 

d 

Qc = {Qa,Qb} = 2yn-i{2ayn-i + yi) - yn-i^^QA^y)- 
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Thus, 

Qc = Vn-iii ■ y) , 

for some 7 G M"^^. 

Assume that yn-i 7^ 0, and ayn-i + yi = 0. Then QB{y,s) = for every s G M. 
Moreover, we can choose s = s{y) such that Qa^J^ s) = 0. Then, by ()H1|) . Qc{y, s) = 0. 
Thus, aUn-i + 2/1 = always imphes 7 • |/ = 0, so that 7 = c(ei + cre„_i), for some c G M, 
hence Qciv) = cyn-iiyi + o'Vn-i) = cQsiy)- Thus C hes in the span of A and B. 

Case 1(b). rank 5i > 3. 

Since Bi is not semi-definite, every connected component of dV Bi \R then spans M""^, 
where R denotes the radical of Qbi- This can be seen by a similar argument as in the 
proof of Lemma f3.1[ Let V be such a component of BTb^ \ R, and consider 

M) := {{y,s{y)) G : y G P, > and s{y) = -iQ^, (2/)/yn-i}. 

Then Ao is a connected submanifold of dimension n — 2 contained in V, hence contained 
in a stratum Af of maximal dimension. By our assumption, A/q is also contained in a 
hyperplane. Since V spans, we can then find some vector 77 G M"^^ such that 

s{y) +r]-y = for all y G P+ := G P : yn-i > 0}, 

hence 

Qa^ (y) = 2?/„_i(r7 ■ y) for every y G ]R""\ 

Put 

Qd,(2/) := QaM - 22/n-i(r/ ■ y), y G M"-^ . 

Then vanishes on V~^, hence, by analyticity, also on the stratum Q of OTbi containing 
V~^, as well as on —Q. However, fiU (— fi) is dense in OTbi, so that vanishes on ^F^^. 
By Lemma f3. II (a), there is thus a constant c G M such that 

Qdi = cQbi ■ 

Replacing A hy ^{A — cB) (possibly dropping the assumption that rank A = r), we see 
that 

(3.14) QA{.y,s) = yn-iiv y) + syn-i = yn-iiv y + s), 

Qsiy^s) = QsAy)- 

Similarly as in the previous case, we can now choose symplectic coordinates in V such 
that 

Vy = cryn-i + P2/1 , 0-, p G M , 

so that 

QA{y, s) = yn-iipyi + (ryn-i + s). 

Then 

d d 

Qc = {Qa,Qb} = yn-i^ — QsAy) - py-n-i^QBAy) 

oyn^i oy2 

= yn-iii-y), 
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for some 7 G M" ^. We may assume 7 7^ 0. 

Let then y G OVb^ such that Un-i 7^ 0. Then we can choose s = s{y), such that 
{y, s) G V, hence, by dHU), ?/„_i(7 ■ Z/) = 0. 

This shows that {y G M""^ : QbAu) = O5 7^ 0} li^s in the hyperplane 7-*-, so that 
dV is contained in the union of two hyperplanes. This is, however, not possible, since 
rank i?i > 3, so that the strata of dimension n — 1 in dB^ are not flat. 

Case 2. span M ^ H. 

Let W := spanjjA^. Since Ai has codimension 1 in H, we see that W has codimension 
1 too, so that is an open subset of W. And, Qa, Qb vanish on Ao = 7V1 x M, hence 
also on 14^ X M, so that M. = W and Ao = 14^ x M. Since Ao is a linear subspace of 
codimension 2 in M", we may introduce new orthonormal coordinates Xi, . . . ,x„ in 
such that 

A^o = {x G M" : Xn-i = x„ = 0} . 

Splitting coordinates x = {z, y), with z := (xi, . . . , Xn-2) £ y := (x„_i, x„) G M^, 

we can therefore write 



with respect to these blocks of coordinates. Notice that rank A2 < 2. 

Then, by Lemma f3. 21 r = rank A < 4, in contradiction to our assumptions. So, under 
the hypotheses of Theorem 13.51 this case cannot arize. 



Remarks 3.6 (a) The statement of Theorem 13.51 fails to be true, if r to small, e.g., if 
r = 4. 

Consider, e.g., the following counterexample in = x M^, with coordinates 
{x,y), X = (xi,X2), y = (?/i,?/2), from 5 , Corollary 1.4: 



The corresponding matrices A and B are non-degenerate. Moreover, putting ^ := X2), 



Qa = ^-{Jv), Qb = -C-v, 

and thus {Qa = 0} n {Qb = 0} = {(^,77) G x - ^ = q or r/ = 0}. Therefore, none 
of the connected components of Af span M'^. However, 



so that A, B and C do satisfy our standing assumptions and are linearly independent. 

(b) Also the condition on the joint radical of Qa and is important, as the following 
example shows: 




Q.E.D. 



Qa{x, y) := Xiy2 + X2I/1, Qb(x, y) := Xiyi - X22/2 • 




Qc = {Qa, Qb} = 2{xiy2 - X2yi) , 
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Let ei, . . . , /i, . . . , /rf be a canonical symplectic basis of , d >2, with associated 
coordinates {x,y) = {xi, . . . ,Xd,yi, ■ ■ ■ , Vd), and put 

(3.15) QA{x,y) := xl-{yl + --- + yj_^+xl + --- + xl_^), 
Qsix^y) := xiXd- 

Then A, B form a non-dissipative pair, since, after a suitable scaling in xi, we may assume 
that the matrices corresponding to A and B have vanishing traces. Moreover, 

Qc ■= {Qa,Qb} = -'^yiXd, 

so that and A, B and C are linearly independent. Then rank A = 2{d—l), and TZa,b = ^fd 
is isotropic with respect to the symplectic form on M^"'. Moreover, A, B and C are linearly 
independent. Nevertheless, Qc vanishes on {Qa = 0} H {Qb = 0} . 

(c) The condition that Qc '■= {Qa,Qb} cannot be dropped either, as the next example 
demonstrates: Let 

(3.16) QA{x,y) := xl-{yl + --- + yl + xl + --- + xl_^), 
Qsix.y) := xiXd- 

Then again A^B form a non-dissipative pair, as can be seen as before, and 71a,b = {0}. 
Let 

Qc ■= VjXd, 

for any j = 1, . . . ,d. Then A, B and C are linearly independent, and rank {A, B} = 2d. 
Nevertheless, Qc vanishes on V = {Qa = 0} H {Qb = 0} = Me^ U {{x,y) : Xd = 
and QA{x,y) = 0}. Notice that here the strata of V of maximal dimension ly in the 
hyperplane {xd = 0}, but there is a lower dimensional stratum not lying in this hyperplane. 

If we slightly modify Qa, by putting 

Qa{x, y) := xl - {yl + ■ ■ ■ + yd + xl + ■ ■ ■ + xl), 

the situation remains the same, only that now V lies completely in the hyperplane {xd = 
0}. 

In all these examples, minrank {A, 5} = 2. We shall prove later in Lemma l3. 131 that 
this is necessarily so, if no stratum of A/" spans M". 

3.3 The case where at least one stratum of J\f spans W^. 

Let us now go back to our standing assumptions, not requiring that M" is symplectic and 
C satisfies (H2). However, let us assume that 

(3.17) spanMAro = M", 
for some connected component Ao of J\f. 
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Notice that then, if Uq is a non-empty open subset of Aq, also Uq spans M", by 
analyticity and connectivity of Aq. For xq G A/", we denote by 

Vxo ■■= T^oU = (spanM {Axo, Bxq})-^ 

the tangent space to J\f at xq. 

Moreover, if D G Sym (n, M), then 

Qd,xo '■= QdIv^q 

denotes the restriction of the quadratic form Qd,xo to Vx^. Similarly, if xo,xi G A/", we 
put 

Qd,xo,xi ■= <5D|y(,„,,^) • 

Lemma 3.7 Given xq G A/", i/iere exzs^ a(xo),/9(xo) G M such that 

(3.18) Qc,xo = a{xo)QA,xo + P{xo)Qb,xo 
and 

(3.19) Cxq = a{xo)Axo + P{xo)Bxo . 

The a{xo), f3{xQ) may not be unique, but can locally on M be chosen as real-analytic 
functions of Xq. 

Proof. Fix Xq G Af. Since VQa{xq) = 2Axo and VQb(xo) = 2Bxo are linearly indepen- 
dent, possibly after relabeling the coordinates of M", we may assume that 

0(x) := (xi, . . . , Xn-2, Qa{x), Qb{x)) =■■ (x', y) 

is a local analytic diffeomorphism near xq. In the new coordinates {x',y), the point xo 
corresponds to (xq, 0), and Af to {y = 0}. Let f := f o0~S if / is a function defined near 
Xq. Since Qc vanishes on Af, a Taylor-expansion of Qc near (xg, 0) shows that 

Qcix', y) = yia{x', y) + i/2/3(x', y) , 

for suitable analytic functions q;,/3 defined near (xq,0). Thus, near xq, 

(3.20) Qc{x) = «(x)Qa(x) + P{x)Qb{x) , 

for some analytic functions defined near xq. Taking first derivates at xq, we obtain 

dnni). 

Moreover applying the second derivative to ()3.20|) . we obtain 

(3.21) C = a{xQ)A + (3{xq)B + M{xq) , 
where 

(3.22) 2M(xo) := «'(a;o) ® Axq + Axq ® a\xQ) 

+(3'{xq) ® Bxq + Bxq (g) P'{xo) . 
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This implies (|3.18|) . 



Q.E.D. 

For Xo,Xi E A/q, let 

N{xo,xi) '■= span^ {Axo, Bxq, Axi, Bxi} , 

so that V(^o,a;i) = ^{io,xi)- Then dim Ni^^^^x^) > 2. If dim A^{xo,xi) = 2 for all (xo,xi) G 
A^o^, then Vx^ = V^q for all xq, Xi G A/q, so that Ao would not span M". So, if we put 

m := max dimiV(^o^a,^) , 

then m G {3, 4}. 

Let us call a subset U of an open domain Q C M"^ a generic set or set of generic 
points in fi, if there exists a non-trivial real analytic function f : Q ^ such that 
U = {x E fl : f{x) 0}. A property will hold for generic points in Q, if it holds for all 
points of a generic subset. 

Notice that a generic set in Q is open and dense in Q. Clearly, the intersection of a 
finite number of generic sets in Q is again generic. 

Moreover, ii m = k + £, and if [/ is a generic subset ofn CR'' X R^, then let C 
R'', C R^ be any domains such that fi^ x 0."^ is compact in fi. Then Ui := {x G fi^ : Ux 
is generic in Q'^} is generic in Here Ux denotes the x-section 

Ux:= {yen^:{x,y)eU} 

of U. Indeed, if ?7 = {{x,y) G : f{x,y) ^ 0}, then fii \ f/i = {x G : D^f{x,0) = 
for all a G N^}. Thus, if we put 

gix) := ^£«D°/(x,0)^ 

for a suitable family at coefficients Ea > tending to sufficiently fast as |a;| ^ oo , then 
g is a non-trivial real analytic function on Q^, and 

Ui = {xen^ : g{x) ^ 0} . 

Analogous definitions and results apply for open domains in a real analytic manifold. 

If m = 3, and if dim N(^xo,xi) = 3, then three of the vectors Axq, Bxq, Axi, Bxi are 
linearly independent, say, e.g., Axq A Bxq A Axi ^ 0. But then this holds for generic 
pairs (xo, x\) G A/"o^, by analyticity and connectivity of A/q, hence dim V{xq^xx) = n — 3, for 
generic {xo,xi). A similar argument applies to the case m = 4. Therefore, the set 

Q := {(xo, xi) G A^o^ : dim V(^xo,xi) = n - m} 

is generic in Ag^, and dim V(^xo,xi) > n — m for all (xq, Xi) G Afg. 

Proposition 3.8 Assume that A, B and C satisfy our standing assumptions, and that 
()3.17|1 holds. If Qa,xo,xi and Qb,xo,xi are linearly independent for some (xo,xi) G Q, then 
C lies in the linear span of A and B. 
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Proof. Choose connected open neighborhoods Uj of Xj, j = 0, 1, in A/q such that UqxUi C 
g. For {y, z) eUoxUi, we have, by (jSUHl), 

Qc,y,z = a{y)QA,y,z + l3{y)QB,y,z , 

as well as 

Qc,y,z = a{z)QA,y,z + P{z)QB,y,z ■ 

Moreover, Qa,xo,xi A Qb,xo,xi 7^ 0. Shrinking Uq and Ui, if necessary, we may therefore 
assume that also QA,y,z A QB,y,z 7^ for every {y, z) E Uq x Ui, so that 

a{y) = a{z), P{y) = P{z) for all {y, z) e Uq x Ui . 

Putting ao ■= (y{xi), Po '■= Pi^i), we see that 

(3.23) a{y) = ao, (3{y) = (3q for all y e Uq . 

But, since Uq is a non-empty open subset of A/q, and since Ao spans M", then also Uq 
spans M", by analyticity and connectivity of Aq. ()3.23j) and ()3.19j) imply 

Cy = aoAy + (3oBy for all y e Uq , 

and since Uq spans, we obtain 

C = aoA + (3oB . 

Q.E.D. 

There remains the case where 

(3.24) Qa,xo,xi a Qb,xo,xi = for all (xq, Xi) E Q . 

Lemma 3.9 Let A and B satisfy our standing assumptions, and that there exists a non- 
empty domain U C Q such that QA,x,y and QB,x,y are linearly dependent for every {x,y) G 
U. Then there exists a non-trivial linear combination D = aA + (3B of A and B such 
that 

QD,x,y = for every (x, y) E U , 

provided r > 17. 

Proof. Since Ni^^^y-^ = span^ {Ax, Bx, Ay, By} varies analytically in (x, y) E Q, shrinking 
U , if necessary, we may assume that there is an orthonormal basis (constructable, e.g., 
by the Gram-Schmidt method) 

ei{x,y),. . . ,en-m{x,y), {x,y)EU, 

of V{x,y), varying analytically in {x,y). Put 

E{x, y) := (ei(x, y)),..., e„_„(x, y) E M">^("-™)(M) , 

and 

A{x,y) := 'E{x,y)AE{x,y), 

B{x,y) := 'E{x,y)AE{x,y), {x,y)EU. 
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Then A{x,y) and B{x,y) are real {n — m) x [n — m)-matrices, representing the forms 
QaIvj^j^) and Qslvf^y^ with respect to the above basis of V(x,y)- By Lemma we have 

(3.25) rank A{x, y) > r — 2m 

If r > 9, we have in particular that A{x, y) ^ 0. Since QA,x,y A QB,x,y = 0, there exists 
thus a unique a{x, y) eM. such that 

(3.26) B{x,y)=a{x,y) A{x,y), {x,y)eU. 

Since a{x,y) is unique, it depends analytically on {x,y) e U. 

Assume a is non-constant on U. Then we can choose a differentiable curve 7 : / — > f/, 
such that n := a o 'J : I ^ M. is non-constant. Put E{t) := £^(7(t)), and 

A(t):=A(7(t)), i?(t) := 5(7(t)), tel. 

Then 

*E{t)BE{t) = /i(t) ^E{t)AE{t) for every t G ] - 1, 1[, 

so that, by Lemma (3.31 r < 4m < 16, contradicting our assumptions. 

Consequently, a is constant, i.e., a = ao, for some ao G M. Putting D := B — aoA, 
we find that 

QD,x,y , 

first, for every {x,y) in our shrinked domain U G Q, but then also for all {x,y) in our 
original domain U. 

Q.E.D. 

Lemma 3.10 Assume that Aq spans M", and that r > 12, and let Ui he a non-empty 
open subset o/Aq. We also assume (|3.24|) . 

Then, for generic Xq G Ui, there exists an Xi G Ui, such that for every sufficiently 
small neighborhood Ui of xq and U2 of Xi in Ui, the following hold: 

U := Ui X U2 C Q , and the union of the spaces V[x,y), {x,y) G U, spans M". 

Proof. Without loss of generality, we may assume that — is so small that ranki? = 
rank A = r. 

For generic Xq G Ui, there is some Xi G Ui such that {xo,Xi) G Q. Given such a pair 
(xo,Xi), choose open neighborhoods Ui of Xq and U2 of Xi in Ui such that U C Q. 

Assume now that IJ{^(a;,»/) '■ i^jV) ^ U} does not span M". Then there is a unit vector 
z/ G M" such that z/ ± V(x,y), i-e., z/ G A''(2^,y), for all (x, y) G U. 

We can exclude that u A Ax A -Bx = for every x G t/i. For then u G span {Ax, Bx}, 
hence Vx C z/^ for every x G t/i. But then C z/-*- for all x G A/q, by analyticity and 
connectivity of Afo- This implies z ■ u = const, for all z G A/q, and since G Aq, we have 
2; ■ z/ = 0. Thus Ao C z/-*-, in contradiction to our assumptions. 

Thus, uAAx a Bx ^ for generic x G t/i. Choose Xq G f/i and an open neighborhood 
U[ of Xq in f/i, such that 

(3.27) u A Ax A Bx for every x eU[, 
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and put U' := U[ x U2 C U. 

Assume now first that m = 3, and that, e.g., 

N(x,y) = spaiaM.{Ax,Bx,Ay} , 

first, for (x, y) = (xg, Xi), and then for every (x, y) G U' (shrinking U[ and U2, if necessary). 
Since u G N(^x,y)i we have v A Ax A i?x A Ay = 0, hence, by ()3.27|) . 

Ay G spaniR {z/. Ax, Bx} for all (x, y) E U' . 

Fixing X E U[,we see that Ay lies in the 3-dimensional subspace span^ {z/, Ax, -Bx}, for all y G 
?72, so that {Ay : y G U2} does not span M". But then does not span either, for oth- 
erwise, span K {Ay : y E U2} = range A would have dimension r, hence r < 3. The case 
where iV(a, = span^ {Ax, Bx, By} can be treated in the same way. 

There remains the case m = 4. Then 

Ax A Bx A Ay A By ^ , 

and 

u G spaniR {Ax, Bx, Ay, By} for all (x, y) E U[ x U2 ■ 
By fj3.27p . this implies that there exists {a{x,y), P{x,y)) G \ {0}, such that 

(3.28) a{x,y)Ay + P{x,y)By E spa.n^{h'. Ax, Bx} for all {x,y) E U[ x U2 ■ 

Moreover, since r > 9, the proof of Lemma f see ()3.26p ) shows that we may assume 
that 

Qb ,Xo,Xi ; 

for some E M. Put D := B — OqA. Then D ^ 0, and Qd,xo,xi = 0. By Lemma 13.21 
then implies that rank/} < 2m = 8. 

Fix X in ()3.28j) . and put Wx := spauK {u. Ax, Bx}. Then 

a{x, y)Ay + (3{x, y)By E for all y EU2. 

Writing B = aoA + D, we have, by (jS2Hl), 

(a(x, y) + aoP{x, y))Ay E + range D. 

If a{x,y) + aoP{x,y) 7^ for some y E U2, then this implies r = rank A < 3 + 
rank D < 11, so that this case cannot occur. Assume therefore that a{x,y) + aoP{x,y) = 
for all {x,y) E U[ x U2. Then, by (nOHjl . 

p{x, y){-aoA + B)y E for all y G f/2 . 

But, since rank A = r > 12, ()3.28|) implies that (3{x,y) cannot vanish identically on U2, 
for generic x eU[, so that 

Dy = {-aoA + B)y E W^, 
for generic {x,y) E U[ x f/2. Thus, since f/g spans M", 

ranged C Q =: W, 
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for some non-empty open subset Vi in U[. In particular, rank D < 3. 
But, if = Wy for all x, ?/ G Vi, then, for fixed x. 

Ay G Wx for every y G Vi , 

hence ranged C W^-, since Vi spans M", a contradiction. Therefore, dimW < 2, hence 
rank D <2. Since Z) cannot be semi-definite, we thus have rankD = 2 . Then, there are 
^, 7] G M" \ {0} such that Qd{,x) = ■ x)(?7 ■ x). But this implies 

so that A'o does not span M", in contrast to our assumptions. 

Q.E.D. 

Lemma 3.11 Let A,B E Sym(?2, M) satisfy our standing assumptions. Assume fur- 
ther that there is a non-empty open subset U G Q such that the union of the spaces 
i^jU) ^ U, spans M", and r > 12. If D G spaniRjA, 5}, then the condition 

(3.29) QD,x,y = for all {x, y)eU 
implies D = 0. 

Proof. Assume that D satisfies ()3.29|) . but that D ^ 0. Then spanulA, D} = spaji^{A, B}, 
so that we may assume without loss of generality that D = B. Notice, however, that we 
can then still assume that rank A = r, but no longer that also ranki? = r (deviating thus 
slightly from our standing assumptions), since B then may not be close to A. We shall 
show that these assumptions lead to the contradiction that B = 0. 

As in the proof of Lemma 13.91 we may assume that there is an orthonormal basis 
ei{x,y),..., en-m{x, y) of V(^,y), varying analytically in (x, y) G U. 

(a) We begin with the case m = 4. Putting 

fi{x,y) := Ax, f2{,x,y) := Bx, fsix^y) := Ay, fi{x,y) := By, 

then 

ei{x, y), . . . , Cn-A^x, y), fi{x, y), . . . , f^ix, y) 
is a basis of M". Consider the mapping F : U x M""^ —>■ M", 

n— 4 

F{x, y, z) := ^ z^ej[x, y), (x, y)eU,ze M""^ , 

where we consider U as an analytic submanifold of M" x M" of dimension 2(n — 2). 
We shall prove that there is some (xo,?/o,-2o) such that 

(3.30) rank DF{xo, yo, zq) = n . 

This implies that F is a submersion near {xQ,yo,Zo), so that [J(x y)&u^i^,y) contains a 
non-empty open subset Q of M". Since, by ()3.29|) . Qb vanishes on fl, then Qb = 0, hence 
B = 0. 
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To prove (|3.3U|) . notice that 



and 



V, = {^eW: e ■ (Ax) = 0, e ■ (Bx) = 0} . 
Consider, for x, y, z fixed, the hnear mappings 

i)i := KxK^^M, 

:= iA^^y)-{D(^.y)F[x,y,z){i,i])), z = l,...4. 

We claim that (|3.3Up holds for (xq, ?/0) ^^o) := (x, z), if and only if the linear mapping 



^ : = 



has rank 4. 

To this end, observe first that -F(x, 2;) is linear in z, so that 

(3.31) DF{x, z){i, rj, () = D(^,,y)Fix, y, z){^, r/) + F{x, y, ()■ 

Noreover, if fl{x,y), . . . , f^{x, y) denotes the dual basis of A''(x,y) with respect to the basis 
h{.x,y),. . . Ji{x,y), i.e., if 

fii^^y) ■ fj{x,y) = Sij, 
and if 'ipi^^, rf) = Wi, i = 1, . . . , 4, then let us put 



V 



Then 



fj{x,y) ■ [v - D{x,y)F{x,y,z){^,ri)] = 0, j 



1,...,4, 



so that V - D(^^^y)F{x,y,z){^,r]) G V(^,y), i.e., 

n— 4 

D(x,y)F{x,y,z){^,ri) - V = -'^Cjej{x,y) , 
for some (unique) (' = {([,..., Cn-4) ^ K""^. This implies, by (I3.3ip . 

n-4 

D{x,y,z)F{x, y,z){^,ri,C + C) =v + Y^ Cj^jix, y) for all C G 

showing that DF{x,y,z) is surjective if and only if \1/ is surjective. 
Observe next that 

fi{x,y) ■ F{x,y,z) = 0, i = l,...,4. 



T>n-4 
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so that, by the product rule, 





= -[ 
= -J 


ies 










V 



\B-F{x,y,z)) 










\ 



\A-F{x,y,z)) 
XB-Fix,y,z)) J 



^ 0. 



Notice that, for (x, ?/) G V fixed, there is some z G M""^ such that ■i/'i 
Indeed, otherwise we would have {Av) ■ ^ = for all G Vix^y)-, ^ ^ Vx, and in particular 
QA,x,y = 0. But then rank A < 2 ■ 4 = 8, hence r < 8, a contradiction. This shows that 
ipi ^ and ips ^ 0, for generic z, so that 

2 < rank < 4, for generic z . 

If rank \E' = 4 for some (x, y, z), then ()3.30|) holds, and thus again B = 0. 

So, assume rank \I' < 3 for every (x, y,z) ^ U x M"^'*. Then, either the first two 
rows of \E', or the last two rows are linearly dependent, when considered as linear forms 
on Vx X Vy (for generic z). 

If the first two rows are linearly dependent for every (x, y, z), putting v := F(x, y, z) G 
'^{x,y)i we see that there is some coefficient vector (a(x, y, i;), /9(x, w)) G \ {0} such 
that 



(3.32) 



(a(x, y, v)Av + /3(x, v)Bv) ■ ^ = for all ^ G 



for every (x, y) eU,v e V(^x^y). 

Choosing C, = v E V(s,?/), in view of ()3.29|) this yields 



a{x,y,v)QAiv) 



0, 



and by Lemma IT^ (compare also (j3.25j) ). since r > 9, (5yi('y) 7^ for generic v, so that 
a{x,y,v) = for generic v G V(x,i/), hence P{x,y,v) ^ for generic v G Vj;^;^^). Thus 

(-Bt;) • ^ = for generic v G V(x,y) , and all^ G . 

But then this holds for all v G V(a;,j/), ^ G K.., so that 

(3.33) B{y(x,y)) C spauKjAx, -Bx} for all (x, ?/) G f/ . 

We now distinguish two cases. 

Case a.l: rank\E' = 2 for every (x, y) G f/ and generic z. 

Then the first two lines, and also the last two lines of are always linearly dependent, 
for generic z, and the preceding discussion, in particular (j3.33|) . shows that 



-B(V(a;,j/)) C span]R{Ax,5x} 
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and analogously also 

B{V^^^y)) C spanK{Ay,By} , 

for all (x, y) G U. Thus 

B{V(a:,y)) C spans {Ax, Bx} n spanK{yl?/, 5?/} = {0} , 

hence -B|v(^y) = 0. Since U(x j/)gc/ ^(^^.y) spans M", this implies again 5 = 0. 
There remains 

Case a.2: rank \E' = 3 for generic {x,y,z) G f/ x M""^. 

Shrinking U, if necessary, we can then assume that, e.g., the last two rows of \& are 
linearly independent for generic {x,y, z), and consequently the first two rows are linearly 
dependent, for every {x,y,z) G U x M""^. Freezing x, for generic x, and applying the same 
reasoning as before to the mapping : {y, z) h-* y, z) instead of (x, z) ^ F{x, y, z) 
(by setting ^ = 0), we see that rank (^^) = 2 implies that D(^y^z)Fx{x, y, z) has rank n — 2, 
for generic (y, z). This implies that, for every x in some open set Ui C Ao, the image Wx 
of -Fj: contains an analytic sub manifold VL^ of dimension > n — 2. 

But, if U2 is an open subset of A/q such that Ui x U2 C U, then 

C := {F{x, y,z):yeU2,ze R^~'} = [j V^x,y) C K . 

yeU2 

Since dim = n — 2, we see that is an open subset of V^. 

And, since ()3.33|) still holds in the present case, we see that B{Qx) C spauKjAx, Bx}, 
hence 

(3.34) B{Vx) C spanalAx, for all x e Ui . 

By Lemma (3.101 we can find non-empty open subsets Ui, U2 in Ui such that U' := t/i x 
U2 C ^, and so that 1J(xs/)g(7' ^(^.j/) spans M". Then, by (j3.34|) . also 

B{Vy) C spaniR{Ay, 5?/} for all y e U2 , 

so that 

E(i^(,,j,)) = B{VxnVy)cB{Vx)nB{Vy) 

C spauRjAx, n span]^{Ay, By} = {0}, 

for all (x, G f/'. Again, we arrive at the contradiction that B = 0. 
(b) Assume next that m = 3. 

Except for an exchange of the roles of x and y, there are then the following two possibilities: 

(b.l) Ax A Bx A Ay 7^ 0, for some (x, y) = (xq, ?/o) ^ ^• 

Then, after shrinking U, if necessary, the same holds for all (x, y) G U, so that 

A(a;,y) = span ^{ Ax, Bx, Ay} for all (x, ?/) G f/. 

(b.2) Ax A Bx A 7^ 0, say, again, for all {x,y) G U (after shrinking U). Then 

A(a:,j/) = spanujAx, i?x, 5?/} for all (x, y) G ^7. 
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We begin with Case (b.l). Since the arguments are quite similar to the ones in Case (a), 
we shall content ourselves with a brief sketch, just indicating the necessary modifications. 
Choose again an orthonormal basis 

ei{x,y), . . . , e„_3(a;, 

of V(^x,y), varying analytically in {x,y) G U, and put, for {x,y,z) fixed. 



/ M^,V) \ I \A-F{x,y,z)) 

^(e,^)= ^2(e,r/) =- \B-F{x,y,z)) 

\^^{i.ri) ) \ \A-F{x,y,z)) 




Then, for (x, y) G U , 

2 < rank\E' < 3, for generic 2;. 

If rank \E' = 3 for some (x, y, z), then the image of F contains again an open subset of 
M", and we conclude again that 5 = 0. 

So, assume that rank = 2, say, for all (x, y) & U, z 0. Then, the first two rows of \& 
are linearly dependent, so that ()3.33j) holds. Moreover, similarly as in Case (a. 2), for fixed 
X, the mapping F^ : {y,z) 1— >■ F{x,y,z) contains an analytic submanifold of dimension 
> (n — 3) + 1 = — 2 in its image, which is itself contained in Vx- Since dim Vx = n — 2, 
we can conclude as in Case (a. 2). 

We are left with Case (b.2). Here, 

Ay G span ^{ Ax, Bx, By} for all {x,y) G U . 
Let us assume that U is the direct product U = Ui x U2 oi open sets Ui, U2 C Aq. Then 
(3.35) Ay e Nx + range B for all y e U2 , 

for every x G ?7i. 

Now, since QB,x,y = and dim V(^x,y) = n — 3, we see that rank i? < 2 ■ 3 = 6, so that 

dim (Nx + range -B) < 8 . 
On the other hand, since U2 spans M", and since rank A = r, (|3.35p implies that 

dim {Nx + range B) > r. 
In combination, we find that r < 8, contradicting our assumptions. 

Q.E.D. 

Combining Proposition 13.81 and Lemma f3. 91 to Lemma f3. Ill we obtain 

Theorem 3.12 Let A,B,C G Sym {n, M) satisfy our Standing Assumptions \3.4\ Assume 
that maxrank{A,i?} > 17, and that at least one connected component of M spans M"". 
Then C is a linear combination of A and B. 

Applying the same type of technics, we can now obtain further information also on 
the case where no stratum of A/" spans. 
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Lemma 3.13 Let A,B& Sym(n, M) form a non-dissipative pair, and assume that 
maxrank {A, B} > 9. Then the following are equivalent: 

(i) There is a connected component of M which does not span M". 
(ii) No connected component of M spans M". 
(Hi) minrank {A, 5} = 2. 

Proof, (iii) =^ (ii). If minrank {A, i?} = 2, then we may assume without loss of 
generahty that ranki? = 2. This means that there are hnearly independent vectors ^,rj & 
M."' such that Qb{x) = ■ x){ri ■ x). But then clearly every component of lies in one of 
the subspaces or ± . 
(iii) =^ (ii) is trivial. 

(i) =^ (iii). Assume that there is a connected component Mo of M which lies in a 
subspace i/-*-, where t/ is a unit vector. Without loss of generahty, we may also assume 
that rank A = maxrank {A, > 9. Let xo G Ao- Arguing as in the proof of Lemma (3. 7t 
we see that 

(3.36) u ■ X = a{x)QA{x) + P{x)Qb{x), 

for all X in a sufficiently small neighborhood of Xq. Here, a and (3 are analytic functions 
near Xq. Applying the second derivative, and restricting the forms to V^q, we obtain 

(3.37) = a{xo)QA,xo + I3{xo)Qb,xo for all Xq G Mq. 

Notice that I3{xq) ^ 0, since Qa,xo 7^ 0, in view of Lemma IX^ 

Applying next the same kind of reasoning as in the proof of Lemma 13.91 only with 
V[x,y) replaced by Vx and QA,x,y by Qa,x, etc., and m = 2, we see that ()3.37p implies that 
there is a non-trivial linear combination D = oqA + jSoB such that 

(3.38) Qd,x = for all x e TVq. 
Notice also that 

(3.39) spauMA/o = i^^. 

Indeed, otherwise A/q would be an open subset of a linear subspace W of dimension n — 2, 
and = 0. But this would imply rank A < 4, contradicting our assumption on A. 

Arguing similarly as in the proof of Lemma lli.lOt ()3.39|) implies that 

(3.40) IJ K spans z/^, 

x&U 

for every non-empty open subset U of Aq. Indeed, otherwise Uxec/ would be contained 
in a linear subspace W of dimension n — 2, so that, by comparing dimensions, Vx = W 
for every x E U. But this would imply A/o C W, contradicting ()3.39p . 

Finally, we can apply a similar reasoning as in the proof of Lemma 13.111 in order to 
conclude that 

(3.41) QdU=0. 
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By Lemma f3. 21 this implies rankD < 2, hence rankD = 2, and thus minrank {A, B} = 2. 

To prove (j3.4ip . we may assume that there is an orthonormal basis ei(x), . . . , en-2{x) 
of Vx, varying analytically in x G f/. We then put 

:= Ax, f2{x) := Bx, 

so that 

ei{x),..., en-2{x), fi{x), /2(x) 
is a basis of M". Consider the mapping F : U x ]R"~^ i/-*-, 

F{x, z) := ^ ZjCjix) G Cu^, x eU,ze M""^ , 
i=i 

where we consider U as an analytic submanifold of M" of dimension n — 2. 

We shall prove that there is some {xq, zq) such that 
(3.42) rank DF{xo, zq) = n - 1 . 

This implies that F is a submersion near (xq, zq), so that Uxec/ ^ contains a non-empty 
open subset fl of u^. Since, by ()3.38p . Qb vanishes on Q, we thus obtain ()3.4H) . 
In order to prove ()3.42j) . we consider here, for x, z fixed, the linear mappings 

:= V,-^R, 

■■= h{x)-{D,F{x,zm), 2 = 1,2, 

and 

Similarly as in the proof of Lemma 13.111 it then suffices to show that linear mapping \1/ 
has rank 1, generically. But, 

\A.F{x,z)) \ 
\B-F{x,z)) J^' 

and, for x G f/, there is some z G ]R"~^ such that ipi\vx 7^ 0- Indeed, otherwise we would 
have (Av) ■ ^ = for all f G V^, ^ G V^, and in particular Qa,x = 0. But then rank 
A < 2 ■ 2 = 4, a contradiction. This shows that ipi ^ 0, hence rank\l/ = 1. 

Q.E.D. 

Our main result Theorem 11.31 concerning the form problem is now an immediate con- 
sequence of Theorem 13.51 Theorem 13.121 and Lemma 13.131 

Remark 3.14 The statement of Theorem li . 51 remains true, if we replace the canonical 
symplectic form on ]R^°' by an arbitrary constant symplectic form u, and define the Poisson 
bracket accordingly by 

{f,g}^ :=ujiHlH^), 

where H'j denotes the Hamiltonian vector field associated to f (see Section^), and define 
C by 

Qc '■= {Qa, Qb}ui- 

To see this, notice that there is a linear change of coordinates which transforms uj into 
the canonical symplectic form on M^*^, and that the space of quadratic forms and the cone 
of positive-semidefinite forms remain invariant under such a change of coordinates. 
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4 Applications to non-solvability of doubly charac- 
teristic differential operators 

We are now in a position to prove Theorem 11.21 Assume that L satisfies the assump- 
tions of this theorem. Recall that qj denotes the symbol of Xj, so that f{x,C,) '■= 

m m 

''^^ajk{x)qj{x,^)qk{x,^) and g{x,^) := ''^^bjk{x)qj{x,C,)qk{x,C,) denote the real and 

j,k=l j,k=l 

imaginary parts of the principal symbol of L. 

According to Hormander's Theorem I l.H it suffices to prove that there is some 77 G M" 
such that 

(4.1) fixo,r]) = g{xo,r]) = and {f,9}ixo,v) 0. 
One easily computes that 

j,k 

where h is of the form 

(4.2) h = ^djkiqjqhqi, 

i,k,i 

with smooth functions dj^i = djhi{x) depending only on x. Since, as one easily checks, 

{Qa{x),Qb{x)]{x,£,") = 4^v4(a;)J(^,g/')5(a;)t;, v eR"" , 

we thus get 

(4.3) {/, g}{x, = Qcix,^") iq{x, 0) + h{x, , 

if we put q{x, := (qii^, 0, • • • , 9m(a;, 0)- 

Putting := —E{x)C,Q, we have q{xo,C,o) = 0, i.e., (a;o,^o) ^ ^2, so that 

q{xo, ^0 + W, 0)) = v' for every f ' G M™ . 

But, by our assumptions. Theorem 11.31 fmore precisely. Remark 13.141 ) implies that there 
is some v' G M™" such that 

Qa{xo){v') = Qb{xo){v') = and Qc{xo,^'^){v') ^ . 
For < t < 1, let ^{t) := ^0 + (tv', 0). Then q{xo, ^{t)) = tv\ so that 

f{x,,m) = t'QAM{v') = 0, 
g{xo,m) = t%{.o)K)=0, 

and, by (HI, (Q, 

{f,9}ixo,m)=t'Qcixom")i^')+0{t'). 
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But, as t ^ 0, C{xo,i{t)") C{xo,Co), so that 

Vmir'{f,g}ixo,m") = Qc(.o4')K) ^ 0- 
For sufficiently small to > 0, we thus have 

so that ()4.1|) is satisfied for 77 := + (^0"^') 0). 

Q.E.D. 

As an application of Theorem II. 2[ consider a connected, simply connected two-step 
nilpotent Lie group G. Up to an automorphism, such a group can always be realized as 
G = X (as a manifold), with a group law of the form 

{z, u) ■ {z', u') = {z + z',u + u' + ^CzJ^'^z')i) , 

for z,z' G W",u,u' G M^, where J^^\ . . . , J^^^ are skew-symmetric m x m-matrices. A 
basis of the Lie algebra q of left-invariant vector fields is then given by 



d 

Uk := ^— , fc=l,...,- 



Consider an operator L of the form 



(4.4) L = OijkXjXk + lower order terms , 

where the coefficient matrix A = {oijh)j,h £ Sym (m, C) is symmetric. We put A := Re A, 
B := Im^. The matrix {Eji{x)}ji in ()1.4|) is then given by 

k=l 

and, if we split ^ = (C, A^) G x according to the coordinates x = {z, u) G G, we have 

I 

if we put := ^yUjJ^*^ 
Finally, we define 

C,, :=1(AJ^«5-BJ'^M). 
From Theorem II. 2t we then immediately obtain 
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Corollary 4.1 Assume that J'^° is non-degenerate for some fiQ G M^, that A,B forms a 
non-dissipative pair, and that A, B and C^^ are linearly independent. Moreover, suppose 
that either 

(i) minrank {A, 5} > 3 and maxrank {A, i?} > 17, or 

(a) minrank {A, B} = 2, maxrank {A, B} > 9, and that the joint kernel ker A fl ker B of 
Qa and Qb is either trivial, or a symplectic subspace with respect to the symplectic 
form u^g on associated to *(J'^o)~^. 

Then the operator L in fl4.4j) on G is nowhere locally solvable. 

In the special case of the Heisenberg group H^, we have m = 2d, i = 1 and J*-^-* : = 



Corollary 4.2 If G = is the Heisenberg group, assume that A, B forms a non- 
dissipative pair, and that A, B and C are linearly independent. Moreover, suppose that 
either 

(i) minrank {A, 5} > 3 and maxrank {A, 5} > 17, or 

(a) minrank {y4, 5} = 2, maxrank {A, 5} > 9, and that the joint kernel ker A (Ikei B of 
Qa arid Qb is either trivial, or a symplectic subspace with respect to the canonical 
symplectic form on M^^ (associated to — J). 

Then the operator L in ()4.4|) on M.^ is nowhere locally solvable. 

This shows that local solvability of L on Heisenberg groups can essentially only arize 
if the operator e*^L is dissipative, for some 6' G M. This statement is true in the strict 
sense, if, e.g., the matrix A is non-degenerate, and d > 9. 

As we had already mentioned, the examples in [KM] and [MP] show that the analo- 
gous statement is wrong on Heisenberg groups of low dimension 5 and 7. 

Remark 4.3 Theorem, applies also to higher step situations. 

For instance, assume that g is a nilpotent Lie algebra of step r > 3, and let S = 0i C 
02 C ■■■ C Qr+i = {0} denote the descending central series, i.e., Qj+i := [0,0j]. Let 
G = expQ be the associated nilpotent Lie group, and choose elements Xi, . . . ,Xm of g 
which form a basis modulo Q2- Consider the Xj as left-invariant vector fields on G as usual, 
and let L on G be given by ()4.4j) . Put Gj := exp g^, and let if := G3 \ G = {G^g : g e G} 
denote the quotient group of G by G3. Then if is a 2-step nilpotent Lie group, and if we 
assume that also the lower order terms in ()4.4|) are left-invariant, then L factors through 
H left-invariant differential operator 




Then = /iJ, /x G M, so that we may choose n = 1. Putting 



C :=- 
2 




we obtain 
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L = ajkXjXk + lower order terms . 

j,k=i 

Here, Xj is the left-invariant vector field on H corresponding to Xj. 

Choose further elements X^+i, • • • , Xjy such that Xi, . . . , Xj^ forms a basis modulo 
03, and then elements Yi, . . . ,Yk so that Xi, . . . , X^r, Fi, . . . , forms a basis of g. We 
may then choose coordinates {x, y) G x M'^ of G, by putting 



g{x,y) := exp ^J^Z/j^^j exp ^J^a;^^<;j 



Let (,^, rj) denote the dual variables. By 27rcr(A) we denote the principal symbol of a 
differential operator A. Then one easily shows that 

a(X,)((a;,0),(e,0)) = a(X,)(a;,e), 

hence 

(4.5) (T(L)((a;,0),(^,0)) = (T(L)(a;,0 for all ^ G 

(here, we have chosen x as natural coordinates for H). Moreover, since 

we have 

{a{Xj), a{Xk)}{{x, 0), (e, 0)) = za([X„ X,])((x, 0), (e, 0)) 
= za{[X,,Xkr){x, = MX,), a{Xk)}{x, . 

If J{x,^) denotes the skew symmetric matrix on H given in Theorem ll.2l and J{(a;,o),{?,o)) 
the one on G, we thus have 

Thus, if we assume that L satisfies the hypotheses of Corollarv 14.11 then with L, also 
L satisfies the assumptions of Theorem 11.21 so that L is nowhere locally solvable. 
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